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ABSTRACT 

Scott,  Benedict  Joseph.   MS(IE),  Purdue  University, 
June  1955.   "A  Comparison  of  All-day  Time  Study  Versus  Work 
Sampling  For  Measuring  Work  in  a  Navy  Supply  Department." 
Major  Professor:   H.  H.  Young, 

The  basic  objective  of  this  study  was  to  compare  the 
merits  of  All-day  Time  Study  vs.  Work  Sampling  as  methods 
of  measuring  work  for  variable  cycle  operations  and  for  in- 
direct labor  activity.   Comparison  was  made  on  the  basis  of 
experience  and  training  of  analysts  necessary  for  each  type 
of  study,  the  possible  psychological  effects  on  the  worker 
caused  by  the  presence  of  the  observer,  the  preparation  time 
necessary  to  organize  each  type  of  study,  the  time  required 
to  make  the  observations,  and  the  accuracy  of  each  method. 

Necessarily,  all  of  the  factors  of  comparison  were  sub- 
jective except  for  "time  required"  and  "accuracy"  of  each 
method.   Data  collected  in  the  laboratory  was  treated  by  the 
statistical  analysis  of  variance  technique,  using  procedures 
developed  in  Appendix  A.   This  technique  gives  estimates  of 
error  of  each  method,  and,  thereby,  gives  an  objective  basis 
for  comparison  of  the  accuracy  of,  and  the  time  required  for, 
each  method. 


viii 

Eight  operators  in  the  Supply  Department,  U.  3.  Naval 
Ordnance  Plant,  Indianapoli3,  Indiana,  were  observed  for  four 
days  under  a  typical  work  sampling  plan,  and  four  of  these 
eight  operators  were  observed  for  two  different  days  each 
using  all-day  time  study.   The  primary  item  of  data  collected 
was  the  time  spent  on  the  different  functions  of  the  job. 
This  collected  data  was  grouped  and  studied  by  the  analysis 
of  variance  technique  to  isolate  and  estimate  the  error  in 
the  average  time  spent  on  each  function. 

Both  of  the  studied  methods  of  work  measurement  require 
about  the  same  amount  of  training  time  to  assure  that  the 
observer  has  sufficient  know-how  to  make  a  reliable  work 
measurement  study.   Three  weeks  of  formalized  training  would 
be  considered  as  the  minimum  to  provide  competent  data 
takers  under  the  guidance  of  an  experienced  industrial  eng- 
ineer or  time  study  analyst.   However,  the  observer  requires 
more  knowledge  of  the  work  being  measured  to  obtain  ac- 
curate data  by  work  sampling  than  is  necessary  for  the  all- 
day  study.   Thi3  i3  primarily  due  to  the  fact  that  the  con- 
tinuity of  actions  observed  in  the  all-day  time  study  aids 
the  analyst  to  recognize  the  functions,  while  in  the  work 
sampling  study  the  analyst  must  decide  on  a  function  from 
an  instantaneous  observation. 

The  continued  presence  of  the  observer  in  an  all-day 
study  has  a  larger  influence  on  the  actions  of  the  operator 
than  does  the  occasional  appearance  of  the  observer  in  work 


ix 

sampling.   In  this  study,  due  to  the  harmonious  relation- 
ship between  the  observer  and  the  operator,  the  effect  was 
beneficial.   This  is  the  subjective  opinion  of  the  writer, 
but  was  substantiated  by  the  statistical  data.   The  results 
for  the  daily  variability  of  each  worker  (  CTwa)  were  less 
for  the  all-day  study,  indicating  that  the  operators  en- 
deavored to  cooperate  with  the  writer  by  showing  him  their 
version  of  a  typical  day  each  time  they  were  observed. 
This  gave  a  smaller  error  to  the  measured  mean,  but  in- 
dicates an  acute  awareness  of  the  presence  of  the  analyst. 
Had  relations  been  less  cordial  the  results  could  have  been 
less  satisfactory. 

Work  sampling  will  require  more  time  on  the  part  of 
the  analyst  to  set-up  a  study.   This  time  will  be  spent 
drawing  random  numbers  and  coding  the  parameters  in  order 
to  obtain  a  truly  random  sample  of  the  total  available 
population  of  observation  times.   In  addition,  to  obtain 
the  desired  accuracy  or  to  measure  the  accuracy  obtained, 
the  data  for  either  work  sampling  or  all-day  study  should 
be  treated  by  an  analysis  of  variance.   A  little  practice 
at  the  analysis  of  variance  technique  will  soon  enable  an 
analyst  to  obtain  a  high  degree  of  skill  and  accuracy. 

The  overall  statistical  results  indicate  that  the 
work  sampling  plan  used  gave  just  as  accurate  a  measure- 
ment as  the  all-day  study,  but  required  only  one  half 

of  the  observation  time  (and  cost).   Individual  compon- 

f 
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enta  of  error  showed  no  difference  between  the  two  methods 
for  detecting  the  variance  between  men  and  days,  but,  as 
stated  above,  the  all-day  study  gave  a  better  estimate  of 
the  daily  variability  of  each  man.   However,  this  compon- 
ent is  subject  to  the  cooperative  attitude  of  fhe  operator 
and  could  be  strongly  influenced  by  an  antagonistic  work- 
er.  Also,  this  advantage  was  more  than  compensated  for, 
in  this  study,  by  the  increased  efficiency  of  the  work 
sampling  study. 


INTRODUCTION 

Thi3  study  was  conducted  in  an  endeavor  to  compare  all- 
day  time  study  with  the  work  sampling,  or  ratio-delay,  tech- 
nique as  methods  of  work  measurement  for  variable  cycle  op- 
erations and  for  indirect  labor  activity.   The  basic  ob- 
jective was  to  decide  which  is  the  more  desirable  method  of 
estimating  the  average  work  distribution  throughout  an  ac- 
counting period  (day  or  week) ,  when  the  actual  distribution 
varies  from  day  to  day  and  is  only  constant  over  a  longer 
time  element  such  as  a  week,  month,  or  quarter.   Comparison 
was  made  on  the  basis  of  experience  and  training  of  analysts 
necessary  for  each  type  of  study,  the  possible  psychological 
effects  on  the  worker,  the  preparation  time  necessary  to 
set-up  each  study,  the  time  required  to  make  the  observa- 
tions and  the  accuracy  of  each  method.  Obviously,  obser- 
vation time  and  the  accuracy  of  each  method  are  closely 

related  and  must  be  considered  as  variables  to  a  single 

» 
factor. 

The  estimate  of  error  of  each  method  can  be  calculated 
from  observed  variations  among  men,  days,  and  the  daily 
variation  of  each  man.   This  experiment  was  developed  to 
estimate  these  three  components  of  variance.  Certain  re- 
strictions were  placed  on  the  results  because  of  experimen- 


tal  limitations  imposed  by  practical  situations.   Other  fac- 
tors for  comparison  are  somewhat  subjective,  and  these  re- 
sults will  therefore  be  an  expression  of  the  writer's  opin- 
ion of  the  difficulties  associated  with  each  method  of 
study,  at  least  under  the  particular  conditions  of  this 
analysis, 

Experience  and  training  needed  to  prepare  time' study 
analysts* varies  according, to  the  complexity  of  the  indus- 
trial situation  being  studied  and  the  intended  use  of  the 
results  of  the  work  measurement  program.   In  order  to  ob- 
tain a  knowledge  of  the  actual  mechanics  of  taking  all-day 
time  studies,  making  adjustments  and  allowances,  and  pre- 
senting the  data,  a  three  week  period  of  instruction  and 
practice  will  normally  suffice  (1).   This  presumes,  of 
course,  that  the  trainee  will  be  under  the  close  guidance 
of  an  experienced  time  study  analyst  when  he  starts  to 
apply  his  newly  learned  procedures.  The  course  of  train- 
ing given  at  the  Rock  Island  Arsenal  by  the  Army  (2)  con- 
sists of  three  weeks  of  concentrated  instruction  and  prac- 
tice and  appears  to  satisfy  the  needs  of  the  users.   Some 


(l)Rock  Island  Arsenal,  "Ordnance  Management  Eng- 
ineering Training  Program- Work  Measurement  Course  Summary 
Session  Outline",  Rock  Island,  111.,  Rock  Island  Arsenal, 
undated. 

(2)Ibid 


time  is  devoted  in  this  course  to  the  use  of  standard  data, 
and,  in  addition,  one  day  is  devoted  to  work  sampling. 
There  is  some  question  about  the  value  of  only  one  day 
spent  to  cover  the  phases  of  work  sampling  that  differ  from 
all-day  time  study. 

In  a  survey  of  the  previous  work  done  in  this  branch  of 
the  work  measurement  field,  the  writer  noted  a  few  prominent 
names.   L.  G.  H.  Tippett  (3}  is  credited  with  introducing 
statistical  methods  to  work  measurement  in  1935*   The  name 
"Ratio-Delay",  commonly  associated  v/ith  this  statistical 
approach,  probably  came  from  Mr.  R.  L.  Morrow  (if);  however, 
it  has  been  used  in  statistical  quality  control  for  some 
time.   C.  L.  Brisley  (5)  receives  credit  for  coining  the 
name  "work  sampling"  which  is  gaining  favor  because  of  its 
broader  connotation.   In  this  paper,  work  sampling  will  be 
used  to  indicate  this  broader  application;  and  in  subscripts, 

"R"  for  Random  observations,  will  be  employed  for  brevity. 
Some  outstanding  work  in  the  field  has  been  carried  out  by 


(3)Tippett,  L.  C.  H.  "Statistical  Methods  in  Textile 
Researcr. .   Uses  of  the  binomial  and  Poisson  Distribution. 
A  Snap  Reading  Method  of  Making  Time  Studies  of  Machine  and 
Operatives  in  Factory  Surveys."  Manchester,  England,  Journ- 
al of  Textile  Institute  Transactions,  vol.  26,  Feb.  1935, 
51-70. 

(4)Morrow,  R.  1.  "Time  Study  and  Motion  Economy." 
New  York,  Ronald  Pres3  Co.,  1946,  Chap.  16. 

(5) Brisley,  C.  L.  "How  You  Can  Put  Work  Sampling 
to  Work."  Factory  Management  and  Maintenance,  July  1952, 
84-89. 


Abruzzi  (6),  who  has  included  a  thorough  treatment  of  pro- 
cedures for  control  chart  application  in  his  text  "V.'ork 
Measurement"  (7).   Increased  interest  in  the  use  of  work 
sampling  is  evidenced  by  the  fact  that  most  of  the  liter- 
ature on  the  topic  has  been  published  since  1946. 

In  contrast,  all-day  time  3tudy  has  been  used  for 
measuring  indirect  labor  and  office  work  since  the  days 
of  the  Gilbreths   (8).   Dr.  Fredrick  V..  Taylor  (9)  sug- 
gested the  use  of  time  studies  for  variable  operations, 
but  he  spent  most  of  his  efforts  on  direct  production  ap- 
plications.  The  work  by  Mitchell  (10)  in  1927  and  Bills 
(11)  in  1928,  under  the  sponsorship  of  the  American  Man- 
agement Association,  seems  to  have  been  the  first  concen- 
trated effort  to  develop  standard  procedures  for  use  in 
the  clerical  field.   Today,  most  scientifically  managed 


(b)Abruzzi,  A.  "Delay  Allowances  by  Statistical 
Methods."  Columbia  Engineering  Quarterly,  May  1948,  6-3,  23. 

(7) Abruzzi,  A.  "Work  Measurement  -  New  Principles  and 
rrocedures."  New  York,  Columbia  University  Press,  1952. 

(8)Gilbreth,  F.  E.  "Motion  Jtudy."  New  York,  D.  Van 
Nostrand  Co. ,  1911,  88. 

(9)Merrick,  D.  V.  "Time  Studies  on  a  basis  for  Rate 
Setting."  New  York,  The  engineering  Magazine  Co.,  1919. 

(lO)Mitcheil,  J.  "Measuring  Office  output."  New  York, 
American  Management  Association,  Office  Executive  Series  No. 
29,  1927. 

(11) Bills,  M.  A.,  et.  ai.  "Measuring  Office  Output." 
New  York,  American  Management  Association,  Office  Executive 
Series  No.  32,  1928. 


enterprises  use  some  form  of  work  measurement,  both  for 
establishing  incentives  and  for  estimating  budgets  or 
labor  requirements. 


PROCEDURES 

The  procedures  used  in  the  collection  of  data  will  be 
outlined  in  detail.   It  was  necessary  because  of  practical 
considerations  to  depart  slightly  from  the  desired  experi- 
mental procedures,  and  these  departures  have  all  been  either 
justified  or  noted.   The  first  and  most  important  consider- 
ation is  that  the  data  were  collected  under  actual  operating 
conditions,  and,  as  in  all  industrial  situations,  the 
idealistic  experiment  gave  way  to  practical  necessity,  re- 
quiring adjustment  of  some  procedures.   Contrary  to  the 
implication  that  this  might  detract  from  the  value  of  the 
study,  it  is  the  writer's  belief  that  this  will  give  a 
better  basis  for  relying  on  any  data  collected  in  this 
manner  as  being  realistic  and  indicative  of  what  might 
normally  be  expected. 

The  Supply  Department,  U.  3.  Naval  Ordnance  Plant, 
Indianapolis,  Indiana,  hereinafter  abbreviated  as  NOPI, 
was  used  as  a  typical  non-cyclic  work  area  for  the  col- 
lection of  this  data.  The  Supply  Department  is  made  up 
of  five  divisions:  Administration  and  Planning,  Inven- 
tory, Control,  Material,  and  Fiscal.  Of  these  the  Material 
division  and  the  Control  division  each  had  a  fairly  large 


number  of  employees  performing  relatively  homogeneous 
functions  within  the  division.   The  Material  division  was 
selected  because  of  the  lesser  time  needed  for  the  writer 
to  learn  to  recognize  the  functions  performed. 

The  sections  within  the  Material  division  selected  for 
the  study  were  General  Stores,  Ordnance  Stores,  Electronic 
Stores,  and  Bureau  Controlled  Stores.   This  selection  was 
based  on  the  layout  of  the  plant.  The  four  sections  were 
sufficiently  close  together  that  a  work  sampling  study  of 
eight  operators  could  be  cdnducted  with  a  minimum  of  lapsed 
time  between  observations.   In  practice,  one  minute  was 
taken  as  the  period  of  observation,  and  only  three  obser- 
vations were  missed  during  the  entire  period  of  the  study.  ' 
Fig.  1  is  a  sketch  of  the  plant  layout  of  these  four 
Material  sections. 

The  statistical  design  of  the  experiment  called  for  an 
all-day  time  study  on  four  operators  for  two  days  each  (a 
total  of  eight  days),  and  a  work  sampling  study  on  a  mini- 
mum of  eight  operators  for  four  other  days.  Only  one  oper- 
ator was  observed  at  a  time  in  the  all-day  study.  The  four 
operators  observed  under  the  all-day  study,  Operators  1 
through  4,  were  also  observed  in  the  work  sampling  study. 
The  other  four  operators  in  the  work  sampling  study  were 
selected  from  the  same  sections  and  perform  approximately 
the  same  type  of  work.   Thus,  Operator  1,  from  Bureau 
Controlled  Stores,  was  studied  under  both  plans;  and 
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Operator  5,  also  from  Bureau  Stores,  and  performing  the 
same  type  of  work,  was  included  only  in  the  work  sampling 
study.   The  same  pattern  is  true  for  Operators  2  and  6, 
3  and  7,  and  4  and  8. 

The  four  sections  within  the  Material  division  had 
forty-six  full  time  employees.  Since  the  study  was  to 
be  conducted  over  several  months,  in  order  to  fit  into 
the  academic  schedule  of  the  writer,  employees  to  be 
observed  were  picked  for  their  low  record  of  absenteeism. 
Elimination  of  supervisors  and  employees  with  high  absentee 
rates,  and  the  necessity  to  have  at  least  two  employees  in 
each  section  who  performed  fairly  similar  functions,  some- 
what narrowed  the  selections.   Since  the  purpose  of  the 
study  was  to  compare  two  methods  of  work  measurement  and 
not  to  endeavor  to  accurately  estimate  the  work  done  within 
the  division,  the  fact  that  the  quality  of  the  employees 
selected  was  above  average  is  not  important.   It  was  de- 
sirable, however,  that  all  of  the  operators  to  be  studied 
be  selected  in  the  same  way.  Since  four  of  the  eight  op- 
erators were  included  under  both  plans,  it  was  only  nec- 
essary to  make  a  random  selection  of  two  employees  from 
each  section. 

Because  the  writer  was  only  casually  familiar  with 
the  type  of  work  performed  in  the  Supply  Department  at 
NOPI,  the  data  for  the  all-day  time  study  was  taken  first. 
This  was  advantageous  in  that  the  continuity  of  elements 
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that  added  up  to  a  discrete  function  could  be  observed,  and 
the  function  easily  recognized.   At  the  same  time  the  writer 
was,  in  effect,  subjected  to  eight  day3  of  training  in  the 
recognition  of  the  functions  by  recognizing  a  single  element, 
a  series  of  elements,  or  a  form  used;  training  that  was  man- 
datory before  a  function  could  be  discerned  in  a  single 
minute's  observation  as  required  by  work  sampling.   Neverthe- 
less, it  was  necessary  to  spend  two  days  in  the  plant,  pre- 
liminary to  the  taking  of  any  data,  in  order  for  the  writer 
to  become  acquainted  with  the  employees  and  to  learn  to 
recognize  the  functions  performed.   The  word  "function"  as 
used  in  this  paper  is  intended  to  denote  a  series  of 
elements  that  compose  a  task,  but  includes,  in  addition, 
the  paper  work  and  housekeeping  chores  associated  with 
but  not  normally  considered  a  part  of  the  task. 

This  period  served  also  to  enable  the  work  to  be 
broken  up  into  discrete  functions  for  the  recording  of 
time  data.   Seven  functions  were  discerned  to  be  discrete 
and  independent  and  to  be  common  to  all  sections:   issuing, 
receiving,  screening  records,  x-tra,  delay,  and  unavoid- 
able delay.   Definitions  of  these  terms  are  included  in 
Appendix  B.   Delay  and  unavoidable  delay  were  later  com- 
bined because  two  operators  used  their  pockets  in  which 
to  store  work-order  forms.   A3  a  result,  the  only  method 
of  discerning  whether  the  operator  was  in  delay  because 
of  lack  of  work  or  because  of  just  loafing  was  to  ask. 
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This  was  tried;  however,  some  evidence  of  untruthfulness 
was  noted,  and,  since  these  were  the  only  functions  not 
considered  unquestionably  discrete,  it  was  considered 
advisable  to  combine  the  functions  rather  than  to  risk 
a  biased  error. 

Procedures  for  the  all-day  time  study  were  simple. 
Each  of  the  four  operators  wa3  studied  on  a  Tuesday  and 
on  a  Thursday.   No  particular  pattern  was  maintained; 
the  writer  made  a  trip  to  the  plant  each  week  on  whichever 
of  the  two  days  happened  to  be  convenient.   The  operator  to 
be  studied  that  day  was  selected  by  drawing  a  slip  of  paper 
from  a  hat.   As  the  study  progressed  the  choices  were  forced 
by  the  need  for  a  Tuesday  or  a  Thursday  observation  on  one 
or  another  of  the  operators.   The  time  element  was  taken  as 
one  minute,  and  whenever  an  operator  changed  functions  the 
last  minute  was  included  in  the  function  in  process  at  the 
beginning  of  the  minute. 

The  procedures  for  wc^rk  sampling  were  the  best  pos- 
sible under  the  circumstances,  and  appear  to  meet  all  of 
the  requirements  for  a  proper  statistical  analysis  (12). 
The  time  population  was  taken  as  four  days  numbered  in 
sequence;  each  day  consisted  of  480  minutes  (0730  to  1600) 
with  the  thirty  minutes  for  lunch  not  included.   An  element 


(12)McAllister,  G.  E.,  "Random  Ratio-Delay",  Univer- 
sity of  California  Industrial  Logistics  Research  Project, 
Research  Report  No.  12,  Los  Angeles,  April  10,  1953. 
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of  the  time  population  was  taken  as  one  minute.   Each  oper- 
ator was  numbered  (1  to  8).   These  parameters  were  codified 
into  five  digits,  and,  by  use  of  a  five  digit  table  ©f  ran- 
dom numbers,  a  sample  was  drawn  (13).   Sample  size  was 
taken  to  give  the  largest  possible  coverage  of  the  four 
days  -  a  total  of  345  observations.   This  gave  an  average 
of  an  observation  every  six  minutes  which  was  sufficient- 
ly frequent  due  to  the  large  area  t©  be  covered.   The  use 
of  an  unequal  number  of  observations  per  operator  unbal- 
ances the  design  of  the  statistical  model.   It  would  be 
better  to  use  an  equal  number  of  observations,  but,  since 
the  purpose  of  this  experiment  is  to  estimate  the  compon- 
ents of  variance,  the  lack  of  balance  causes  only  minor 
inconvenience. 

At  this  period  of  the  study  a  change  in  the  academic 
schedule  of  the  writer  required  a  shift  from  Tuesdays  and 
Thursdays  to  Tuesdays  and  Y/ednesday3.   A  survey  of  the 
average  time  per  day  spent  on  each  function  showed  no 
significant  variation  in  the  functions  performed  due  t© 
the  day  of  the  week  so  the  change  was  considered  permiss- 
ible.  As  later  brought  out  in  the  results,  a  significance 
test  for  means  showed  that  at  the  5%  level  there  was  no 
significant  difference  in  the  sample  means  for  work  . 

sampling  and  for  all-day  time  study.   They  may  then  be 

i 

(13) Ibid 
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presumed  to  have  come  from  the  same  population.   Again, 

no  pattern  was  maintained  in  the  visits  to  the  plant. 

The  writer  conducted  the  study  on  whichever  Tuesday  or 

Wednesday  of  the  week:  was  convenient,  until  the  need  for 

a  particular  day  forced  a  choice. 
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RESULTS 

The  tabulated  statistical  results  are  presented  on 
the  next  three  pages.   The  compilation  of  data  collected 
is  presented  in  Appendix  D.   Formulae  and  Sample  Calcu- 
lation are  presented  in  Appendix  C.  Appendix  A  has  been 
used  as  the  authority  for  the  statistical  analysis. 

All  statistical  calculations  were  made  in  percent- 
ages. The  results  for  the  all-day  study  are  in  per-cent 
of  total  time,  and  the  work  sampling  results  are  in  per- 
cent of  total  observations.  This  presents  the  means  and 
the  standard  deviations  in  a  highly  desirable  form,  but, 
unfortunately,  the  variances  are  in  square  percent,  a 
less  meaningful  term.  It  is  hoped  that  the  advantage  of 
the  former  will  offset  the  disadvantage  of  the  latter. 
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DISCUSSION  OF  RESULTS  AND  CONCLUSIONS 

Statistical  results  are  subjected  to  tv/o  types  of  error 
sampling  errors  consisting  of  random  and  systematic  errors, 
and  process  errors  consisting  of  systematic  errors  (among 
operators,  machines,  and  time  periods)  and  random  errors. 
Due  to  the  relatively  small  sample  size  used  in  this  study 
the  random  sampling  errors  could  be  fairly  large. 

All  functions  were  tested  to  see  if  the  sample  means 

could  be  considered  as  coming  from  the  same  population, 

i.e.  if  X  AND  X^  can  be  presumed  to  be  estimates  of  the 
R      C 

same  mean.   The  sample  means,  *r  and  xc  for  all  of  the 
functions  were  not  significantly  different  at  the  5$  level 
and  may  be  presumed  to  be  equal  -  and  estimates  of  the  same 
population  mean,  X.  Thus  the  work  sampling  study  was  as 
accurate  as  the  all-day  study  in  the  measurement  of  the 
work  performed,  although  only  one-half  as  much  time  was 
spent  on  the  collection  of  data. 

The  results  on  "screening"  and  Mx-traM  functions  for 
work  sampling  indicate  that  the  number  of  observations 

taken  was  probably  too  small  to  detect  any  variance  in 

X2 

distribution  (there  can  be  no  negative  values),  the  al- 
gebraically negative  solutions  for  the  components  of 
variance  in  these  cases  indicate  very  small  or  no  variance. 
Therefore,  more  observations  would  have  been  needed  to 
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obtain  a  more  accurate  measurement, 

2     2   _   2 
The  estimates  of  components  of  error  (  0"w>  (Td,  G"wd) 

can  not  be  checked  to  establish  their  accuracy.  Because  of 

the  necessarily  small  samples,  these  components  of  error 

are  not  well  estimated,  and  the  large  differences  in  the 

variances,  as  shown  in  the  tables  of  data,  may  be  due  in 

part  to  chance  variation.  A  look  at  the  trends  of  these 

values  may  help  to  substantiate  some  assumptions. 

The  values  of  the  estimate  of  variance  between  workers 
(  C"w)  shows  no  significant  bias.  Neither  method  of  ob- 
servation seems  to  have  caused  significant  changes  in  the 
difference  between  workers. 

In  all  of  the  functions  of  work  sampling,  the  variance 
due  to  days  was  zero,  except  for  receipt  where  the  value  is 
small.  It  was  not  possible  to  separate  the  component  of 
variance  due  to  days  (  C|)  from  that  due  to  the  variability 
of  each  man  on  different  days  (  C"wd)  in  the  all-day  study 
because  no  two  operators  were  observed  on  a  common  day. 
If  it  could  be  presumed  that  in  the  all-day  study  the 
variance  due  to  days  is  approximately  the  same  as  for  work 
sampling,  small  or  zero,  then  the  term  (  (7"a  ♦  ^wa)  could 
largely  be  due  to  Owd»  This  assumption  should  be  valid 
since  the  values  for  £7"?  should  not  depend  on  the  method 
of  observation.  On  this  assumption,  the  lesser  values  for 
variance  obtained  in  the  all-day  study  seem  to  indicate 
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that  the  operators  tried  to  present  a  more  typical  or 
routine  day's  performance  and  thus  cut  down  on  the  day 
to  day  variability. 

If  this  reaction  were  typical  in  studies  conduoted  for 
actual  measurement  of  work,  then  the  all-day  study  would 
show  a  lesser  component  of  variance.   However,  this  ad- 
vantage for  all-day  study  is  more  than  compensated  for  in 
this  study  by  the  increased  efficiency  of  work  sampling. 

In  the  computation  of  total  variation,  G\     and  Uj  , 
the  component  of  variance  due  to  workers  (  G"w)  is  the 
term  which  has  the  largest  effect  on  the  results  (Equations 
4  and  5,  Appendix  A).   This,  as  pointed  out  in  Appendix  A, 
makes  the  more  desirable  work  measurement  plan  the  one  that 
requires  observations  of  a  large  number  of  workers  a  mini- 
mum number  of  times  each.   In  the  results  of  the  data  col- 
lected at  NOPI,  the  standard  deviations,  Cj  and  Oj  , 

ti  c 

for  all  but  one  of  the  functions  are  smaller  for  work 
sampling.  This  tends  to  give  strength  to  the  assumption 
that  the  work  sampling  plan,  with  only  one-half  as  much 
time  required,  gave  as  good  an  estimate  of  the  function 
means  as  the  all-day  study. 

The  experience  and  training  of  the  analyst  for  either 
all-day  time  study  or  work  sampling  can  be  broken  into  two 
parts.  First  and  most  obvious  is  the  actual  mechanics  of 
making  the  study,  including  rating,  adjustments,  and  the 
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presentation  of  data.   The  second  part  is  the  indoctrination 
of  the  analyst  in  the  philosophy  of  Motion  and  Time  Study, 
Labor  Relations,  and  Industrial  Psychology  in  order  to  ob- 
tain the  best  atmosphere  in  which  to  make  the  study  and 
apply  the  results.   This  second  part  will  not  be  discussed 
in  this  paper  on  the  assumption  that  any  interested  parties 
will  have   established  policies  in  the  field  of  labor  re- 
lations and  industrial  management. 

As  previously  mentioned,  a  three  week  course,  such  as 
the  one  used  at  Rock  Island  Arsenal,  seems  to  be  sufficient 
to  train  the  analyst  to  perform  the  mechanics  of  all-day 
study.   In  addition  to  this  training,  the  inexperienced 
analyst  may  require  as  much  as  a  full  working  day  (some- 
times more)  of  preliminary  observation  of  each  job  with 
which  he  is  not  thoroughly  familiar  in  order  to  break  down 
the  job  into  the  functions'  of  interest.  As  noted  in  the 
first  part  of  this  paper,  observing  the  continuity  of  the 
work  pattern  in  the  all-day  study  aids  the  analyst  in 
adding  up  the  elements  for  a  total  function.   This  is  true, 
of  course,  in  an  indirect  labor  or  non  repetitive  situ- 
ation where  the  measurement  is  of  total  functions  and  not 
of  the  elements  which  make  up  the  functions.  This  job 
study  period  can  also  be  utilized  to  establish  a  harmoni- 
ous relationship  with  the  employee  to  be  observed. 

For  work  sampling,  current  literature  implies  that 
little  or  no  training  is  required.  Most  of  these  articles 
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presume,  however,  the  changing  of  a  trained  time  study- 
analyst  to  a  work  sampling  approach.   If  this  is  not  the 
case,  some  formal  training  probably  is  desirable.   A  broad 
knowledge  of  statistics  is  not  required,  and,  since  only 
elementary  mathematics  are  involved,  the  same  mental  capaci- 
ties needed  for  all-day  time  study  will  be  sufficient.   A 
period  of  training  covering  some  statistical  theory,  in- 
cluding the  recognition  of  discrete  and  independent  func- 
tions, the  definition  of  a  binomial  distribution,  the  use 
of  random  digits,  and  the  computation  of  standard  devi- 
ation; the  procedures  for  timing;  the  presentation  of  data; 
and  a  heavy  concentration  of  practice  problems  can  easily 
be  covered  in  three  weeks.   Concentration  on  rating  would 
be  a  point  of  emphasis  since  rating  is  more  difficult  in 
sampling  techniques.   Some*  background  and  related  infor- 
mation would  be  included  to  advise  the  trainee  that  the 
technique  presented  had  definite  limitations  and  that 
these  should  be  recognized.  This  training  should  estab- 
lish a  degree  of  proficiency  in  work  sampling  equal  to 
that  of  the  three  weeks  of  all-day  time  study  training  at 
Rock  Island  Arsenal.   In  either  case,  the  trained  analyst 
would  need  to  work  under  the  close  supervision  and  guidance 
of  an  experienced  time  study  man  or  member  of  the  industrial 
engineering  department. 

In  addition  to  the  factors  noted  above,  work  sampling 
requires  the  recognition  of  a  function  from  only  one  minute 
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of  observation.   For  a  complicated  job  or  one  necessitating 
a  detailed  breakdown,  even  the  most  experienced  analyst  may 
have  to  spend  some  time  studying  the  functions  before  he  can 
recognize  them  with  only  a  brief  observation.   If  a  harmoni- 
ous atmosphere  exists,. the  operator  being  studied  can  be 
trusted  to  give  a  reliable  clarification  when  the  analyst 
is  in  doubt.   The  training  of  an  analyst  who  has  had  some 
experience  in  the  department  being  studied  would  simplify 
matters  some.   The  writer  rejected  a  study  of  a  clerk- 
typist  section  at  NOPI  because  of  hi3  inability  to  recog- 
nize functions  from  single  elements.   To  illustrate;  in  a 
telephone  call  is  the  stock  clerk  checking  on  a  receipt, 
on  an  issue,  or  only  making  a  social  call?  This  difficul- 
ty varies  with  the  degree  of  refinement  desired.   The 
writer's  experience,  based  on  very  little  contact  with 
industrial  operations,  was  to  require  him  to  study  the 
functions  from  one-half  day  to  one  day  to  be  capable  of 
a  (1)  work,  (2)  delay,  (3)  unavoidable  delay  breakdown 
and  at  least  a  week  of  study  in  an  office  requiring  an 
(1)  incoming  paperwork,  (2)  outgoing  paperwork:,  (3)  house- 
keeping (or  other),  {U)    delay,  (5)  unavoidable  delay  break- 
down. 

Having  presumed  in  the  analysis  of  the  co3t  of  train- 
ing that  the  employees  to  be  trained  had  only  the  required 
mental  capacity  and  little  or  no  industrial  experience,  it 
is  unrealistic  to  try  to  analyze  the  question  of  preparation 
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time  to  organize  a  study  unless  the  analyst  has  had  some  ex- 
perience or  is  under  the  close  guidance  of  a  highly  compet- 
ent time  study  analyst.   The  industry  wide  assumption  that 
either  all-day  time  study  or  work  sampling  will  give  reli- 
able data  on  which  to  base  budgets  or  manhour  requirements 
is  based  on  the  assumption  that  the  current  estimated  values 
foretell  future  requirements.   This  is  only  true  if  the 
process  is  stable  and  the  average  work  level  is  constant  over 
the  projected  time  period  and  equal  to  the  estimated  lev- 
el (14).   The  validity  of  the  assumptions  made  in  the  plan- 
ning stage  will  have  strong  influence  on  the  accuracy  of 
the  estimated  data,  and  the  corresponding  value  of  this 
data  for  forecasting  future  requirements.   An  experienced 
time  study  analyst  or  industrial  engineer  should  review  or 
approve  any  plans  or  procedures  for  the  collection  of  data. 

The  preliminary  steps  for  planning  a  study  would  be 
identical  for  either  all-day  time  study  or  work  sampling. 
Once  the  process  to  be  studied  were  known  to  be  in  control 
and  the  mean  was  presumed  to  be  reasonably  stable,  the  ob- 
jective of  the  study  and  the  areas  to  be  measured  could  be 
outlined.   A  preliminary  study  would  be  necessary  to  define 
the  functions  of  interest,  verify  that  they  were  discrete 
and  independent,  and  establish  some  measure  of  acceptance 


(14) Davidson,  H.  0.,  "Activity  Sampling  and  Analysis  - 
Present  State  of  Theory  and  Practice",  New  York,  ASME,  Paper 
No.  53-F-24,  Aug.  1953. 
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among  the  employees.   Some  standardization  of  procedures 
might  be  necessary  in  order  to  obtain  discrete  functions. 
For  example,  had  Operators  3  and  4,  in  this  research  study, 
maintained  their  work-order  forms  in  a  box  or  specific 
place  on  the  workbench  instead  of  their  3hirt  pockets  no 
difficulty  would  have  been  met  in  maintaining  "delay"  and 
"unavoidable-delay"  as  discrete  elements. 

Once  the  preliminary  steps  are  accomplished,  work 
sampling  will  require  additional  work  besides  that  neces- 
sary to  present  the  data.  The  operators,  days,  and  min- 
utes of  the  population  to  be  sampled  must  be  codified, 
and  a  selection  of  random  numbers  made.   The  listing  of  the 
selected  observation  times  in  chronological  order  on  a  work 
sheet,  with  space  for  the  data  to  be  collected,  is  essential 
for  planning  the  sequence  of  the  study  (15).   Detailed  pro- 
cedures will  not  be  outlined  because  of  the  abundance  of 
current  literature  on  this  phase  of  the  topic.  From  the 
bibliography  listed  at  the  end  of  this  paper  the  writings 
of  McAllister,  Rowe,  and  Young  are  recommended. 

The  industry  wide  practice  of  using  the  binomial  formula 


V  sri 


(15)McAllister,  op.  cit. 
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to  decide  the  number  of  sample  observations  required,  in 
order  to  estimate  work  or  delay  elements  with  maximum 
assurance,  (2  (T*  limits  are  typical)  is  correct  only  for 
measuring  the  work  of  one  man  or  crew  worKing  at  a  stable 
process  which  has  a  constant  mean,  It    .   However,  if  more 
than  one  worker  or  crew  is  involved,  then  the  terms  in 
Equation  5  (Appendix  A)  for  G~w,   v  a,  (Twd  must  be  con- 
sidered.  Presumably  in  the  past  the  use  of  only  the  last 

term  of  Equation  5,  the  binomial  formula,  has  been  based 

r-2    r-2      r~2 

on  the  assumption  that  0   w,   v  d,  Vwd,  were  small  or 

equal  to  zero.   This  is  not  true  where  more  than  one  work- 
er is  studied,  but,  conversely,  the  term  for  the  binomial 
distribution  is  small  compared  to  the  components  of  error 
caused  by  the  workers  and  by  the  varibility  of  each  worker 
on  different  days. 

Two  criteria  may  be  used  for  determining  the  extent 
of  the  sampling  study.   If  available  time  and/or  money 
for  the  work  measurement  study  are  fixed,  the  plan  requir- 
ing the  observation  of  the  maximum  number  of  workers  the 
maximum  number  of  days  allowable  will  be  selected.   On 
the  other  hand,  if  a  certain  accuracy  is  required,  the 

plan  requiring  the  observation  of  the  maximum  number  of 

rl 

workers   as   manv  day3  as   are   required   to  reduce     U   x     to 

R 

the  desired   figure  will   be  used.     For  the   latter  plan  an 
analysis   of  variance   can   be  made  at   the   end  of  each  day's 
study,    after   the  first   2  days,    to  see  if  further  obser- 
vation  is   required. 
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The  presence  of  the  analyst  in  the  work  area  has  some 
influence  on  the  action  of  the  worker  and  may  cause  the 
work  activity  to  differ  from  that  normally  performed.   It 
3eems  likely  that  a  time  study  man  standing  a  few  feet 
from  the  worker  all  day  long  may  have  a  considerable  in- 
fluence on  work  performances  while  the  casual  and  some 
times  unnoticed  presence  of  the  work  sampling  observer 
would  have  a  lesser  influence.   The  degree  of  the  worker* s 
reaction  is  not  limited  by  his  knowledge  of  the  presence 
of  the  analyst,  but  is  also  influenced  by  his  knowledge 
of  and  approval,  disapproval,  or  disinterest  in  the  study. 
The  accepted  belief  that  les3  bias  is  introduced  in  work 
sampling  is  based  on  valid  knowledge  of  human  reaction, 
and  the  findings  of  this  writer  can  only  substantiate 

this  belief. 

i 

Excellent  worker  cooperation  and  interest  in  this 

experiment  was  obtained  by  explaining  that  the  observer 
was  a  student  only  interested  in  conducting  an  experiment 
on  two  methods  of  measurement.   The  workers  were  told, 
and  accepted  from  the  start,  that  no  effect  on  pay  scales 
or  hours  would  result  from  the  study. 

Throughout  the  all-day  time  studies,  the  operators 
were  most  cooperative  in  making  sure  that  the  writer 
knew  what  they  were  doing  and  even  why  they  did  it  in 
some  particular  manner.   Despite  encouragement  to  "just 
ignore"  the  writer,  none  of  the  operators  hesitated  to 
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stop  and  explain  every  time  some  interest  was  shown  in  a 
procedure.   One  operator  even  offered  to  save  up  some 
interesting  jobs  until  the  next  visit  of  tne  writer  in 
order  that  he  might  observe  how  they  differed  from  tne 
routine.   In  other  words,  tne  bias  was  there,  and  no 
amount  of  explanation  could  reduce  it.   Had  the  operators 
been  critical  or  antagonistic  to  the  observer's  presence 
the  bias  would  have  been  shown  in  other  forms. 

In  the  work  sampling  study  the  writer  endeavored  with 
a  fair  degree  of  success  to  appear  in  the  operators  pres- 
ence just  at  the  beginning  of  the  time  element  desired. 
The  operators  were  thus  seldom  aware  of  the  writer  until 
after  he  had  observed  the  function  being  performed.   There 
was  no  question  of  popping  around  corners  or  from  the  aisles, 
but  simply  a  knowledge  of  distances  involved  and  the  habit 
of  walking  at  a  3teady  pace  so  that  arrival  within  the 
sight  of  the  work  area  was  usually  within  a  few  seconds  of 
the  desired  time.   Results  were  excellent;  few  of  the  oper- 
ators even  noticed  the  presence  of  the  writer  unless  he 
needed  to  ask  which  function  they  were  performing. 

It  may  be  concluded,  then,  that  the  technique  of 
work  sampling,  or  ratio-delay,  seems  to  offer  reliable 
estimates  of  the  functions  of  interest  in  indirect  or  non 
repetitive  work  situations  within  a  shorter  period  of  ob- 
servation, and  at  correspondingly  les3  co3t,  than  the  all- 
day  time  study  method.   Results  of  this  experiment  further 


29 
indicate  that  the  opportunity  to  observe  more  operators  en 
similar  work,  within  the  observation  period,  by  the  work 
sampling  method  is  primarily  responsible  for  shortening  the 
observation  time  necessary  to  obtain  statistically  accurate 
results. 

The  procedures  recommended  in  Appendix  A  for  the  design 
of  a  work  measurement  plan  to  obtain  the  smallest  variance 
and  thus  the  best  estimate  of  the  mean  are  statistically 
sound  and  should  be  of  value  to  industry.   Practical  limi- 
tations deny  the  full  theoretical  value  of  this  solution 
to  the  users  since  there  are  seldom  areas  in  industry  wnere 
the  number  of  men,  who  perform  the  same  functions,  exceed 
fifty  or  sixty.   The  potentials  of  this  method  of  deciding 
on  a  desirable  work  measurement  plan  can  be  realized  if  a 
reliable  estimate  of  variance  can  be  obtained.   In  small 
or  restricted  areas  of  use,  the  observations  to  obtain  a 
reliable  estimate  of  variance  can  be  almost  as  large  as 
those  needed  to  conduct  the  work  measurement  program. 

A  practical  use  of  this  procedure  may  be  obtained  by 
combining  a  work  measurement  study  with  an  analysis  of 
variance.   The  first  two  day's  observations  could  be  U3ed 
to  make  an  analysis  of  variance  in  order  to  estimate  the 
error.   Using  each  subsequent  day's  collected  data  to 
include  in  an  extended  analysis  of  variance  the  process 
may  be  repeated  until  the  desired  level  of  confidence  is 
obtained.   If  it  is  desired  to  have  the  means  (£)  accurate 


to  -  5$  (  6  "   .05)  at  least  95%   of  the  time,  then 
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^  =  J.  96 


P{  i«  *  #J  *  . 


95 


■"»    fit     =*•"* 

(7"      =    £  .  5  7© 


Thus,  once  the  total  variance  is  reduced  to  6.5$,  the  true 
means  will  be  within  limits  of  -  5%  from  the  estimated  means 
95$  of  the  time.  Rougher  approximations  of  these  values  are 
usually  acceptable  in  certain  uses,  but  if  accuracy  is  im- 
portant, Appendix  A  gives  methods  of  determining  the  ac- 
curacy obtained  or  of  establishing  the  study  to  obtain  the 
desired  accuracy. 


(l6)Burr,  I.  V,.,  "Engineering  Statistics  and  Quality 
Control",  McGraw-Hill  Book  Co.,  New  York,  1953,  69. 
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Training  of  analysts  for  work  sampling  or  all-day  time 
3tudies  will  require  approximately  the  same  amount  cf  time, 
presuming  the  initial  capabilities  of  the  trainee  are  the 
same.   The  end  product  of  a  typical  three  week  course  should 
be  competent  data  takers  who  have  sufficient  background  to 
avoid  obvious  errors.   In  either  case,  the  trainee  would 
need  to  work  under  the  close  guidance  of  an  experienced 
leader.   Use  of  standard  forms  and  procedures  will  increase 
the  speed  and  accuracy  of  any  time  study  analyst. 

Preparation  time  to  organize  a  study  is  shorter  for 
all-day  time  3tudy.   This  is  primarily  due  to  the  step3  re- 
quired to  assure  sound  statistical  procedures  and  reliable 
results  in  the  work  sampling  study.  Any  use  of  time  study 
data  for  forecasting  of  budgets,  workloads,  or  manpower  re- 
quirements is  based  on  certain  assumptions,  and,  therefore, 
all  plans  for  time  study  should  be  based  on  a  knowledge  of 
the  use  of  the  results  and  the  validity  of  the  assumptions 
made.   If  at  any  place  in  time  study  the  supervision  of  a 
skilled  and  experienced  analyst  is  required,  this  must  be 
the  time  and  place  to  utilize  his  knowledge.   Although  a 
knov.'ledge  of  statistics  is  not  needed  for  work  sampling, 
in  the  planning  stage  some  statistical  background  is 
essential.   There  is  a  plentiful  supply  of  literature  writ- 
ten on  the  use  of  statistics  in  work  measurement,  and  most 
of  it  is  well  within  the  mental  capabilities  of  the  aver- 
age engineer.   Some  recommendations  have  already  been  made 
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on  what  seems  to  the  writer  to  be  the  better  literature  in 
this  area,   Others  are  included  at  the  end  of  this  paper 
and  are  marked  with  an  asterisk. 

Work  sampling  is  commonly  assumed  to  produce  less  bias 
than  all-day  time  studies.   In  this  study,  the  operators 
were  less  aware  of  the  presence  of  the  observer  in  the  work 
sampling  study,  and,  presumably,  that  which  was  observed  was 
more  accurate.   However,  due  to  the  endeavor  of  the  oper- 
ators to  present  a  "typical"  day  when  observed  in  the  all- 
day  study,  the  daily  variability  of  each  operator  was  less 
and  the  all-day  study  was  presented  in  a  more  favorable 
light.  This  advantage  is  also  a  weakness  since  the  values 
received  were  subject  to  the  cooperation  of  the  employees. 
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APPENDIX  A 

STATISTICAL  TH3CKY  for  this  EXPERIMENT 
prepared  by- 
Professor  L.  J.  Cote 
Statistical  Laboratory- 
Purdue  University 
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THEORY 

Consider  observing  a  worker  at  several  instants  on  a 
given  day  and  recording  what  he  is  doing  at  each  instant. 
We  might  put  down  the  complete  day  (480  minutes)  as  a  line 
and  darken  the  parts  in  which  he  actually  was  engaged  in  the 
task  of  interest  (A).   The  proportion  of  darkened  parts  is 
the  number  of  minutes  at  task  A  divided  by  480,  Y.../480  z 
Xj4,  for  worker  i  on  day  j.   If  we  pick  a  point  at  random 
on  the  line,  the  chance  that  we  land  in  a  dark  part  is 
Yjj/480,  corresponding  to  the  probability  that  we  observe 
him  at  task  A  at  a  random  instant  during  the  day.  Picking 

n  points  independently  at  random,  the  number  of  times 
we  observe  him  has  the  binomial  distribution  B(n,  X  jj )  t 
and,  as  is  well  known,  the  proportion  of  task  A  obser- 
vations to  n,  is  an  estimate  of  X...   If  p..  is  this 
sample  proportion,  p. .  will  estimate  X. ..   Let 

««       4u  =  pij  .  hi 

be  the  random  error  of  estimation  of  X*  *.   It  is  well 
known  that  Ojj  has  mean  0,  and  variance 

(2)      i*ij<l-*ij) 

This  is  for  a  given  man,  i,  and  day,  j. 

Now  suppose  we  observe  a  worker  all  day  long.  Assum- 
ing this  does  not  change  the  bias,  we  will  obtain  X^*  with- 
out error.   Our  goal  in  any  case  is  to  estimate  the  average 
proportion  of  time  per  day  spent  at  task  A  by  all  the  work- 
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ers  on  all  days.   To  this  end  we  will  observe  several  work- 
ers chosen  at  random  for  several  days  chosen  at  random.   The 
resulting  X, , ' s  will  be  random  also.   We  can  conceive  of 
these  as  being  a  sum  of  various  components 

a)  U  tne  overall  average  we  are  seeking  a  non 

random  quantity, 

b)  w.       the  bias  due  to  worker  i's  average  daily  pro- 

portion of  time  at  task  A   •   We  can  think  of 
the  random  choice  of  a  worker  as  being  the 
choice  of  one  of  these  numbers  from  a  large 
population  of  all  possible  numbers.   The  pop- 
ulation average  of  these  is  zero  since  we  have 

taken  out  JJ    .   The  population  variance  we 

2 

will  call  (T  w»   Thi3  is  a  measure  of  the 

error  introduced  by  sampling  workers. 

c)  di       The  bias  due  to  the  amount  of  task  A  to  be 

done  in  day  j   •   Random  choice  of  days,  as 

of  workers,  means  we  choose  d*s  from  a  pop- 

— .  2 
ulation  of  mean  0  and  variance  \j    a, 


d)    (wd),,   the  actual  difference  between  the  work  done 
by  worker  i   on  day   j   and  the  average  1/ 
♦  w*   ♦   d..   The  mean  of  the  population  of 
these  is  0   ,  and  the  variance  is  \j   wa. 
This  is  sometimes  called  the  experimental 
error. 

Writing  X,,  in  terms  of  these,  we  have 

Xjj   a    dJ     ♦  w^   ♦   d.   *   (wd)ij 
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We  are  now  in  a  position  to  calculate  the  variance  of 
an  all-day  time  study  average.   Suppose  we  choose  a  men  at 
random  and  observe  each  all  day  for   b  days,  taking  k  men 
on  each  day.   Then  there  are  ab  Xi ,'3  and  ab/k  different 
days  in  the  experiment.   We  sum  the  proportion  of  time  each 
day  on  job  A  for  all  the  men  and  all  the  days  and  divide 
by  the  number  of  items  in  the  sum; 

*c    -      i±±       hi 

--  a\  £  £     {>♦  wt  ♦  dj  ♦  (^j 

from  (3) 
All  the  yt/'s  are  the  same  so  the  average  //  $.3  Z/  itself . 
Of  the  w^'s,  there  are  a  different  ones  each  repeated 
b  times  so  the  result  is  w#  an  average  of  a   items.   Sim- 
ilarly there  are  ab/k  different  d.'s  so  that  the  aver- 
age is  d,  an  average  of  ab/k  items.  Finally  the  aver- 
age of  the   (wd)j*  is  (wd),   an  average  of  ab  different 
items.   Thus 


X, 


1  /J  +     w  ♦  5  f  (w3) 


c 

Since  each  of  the  averages  has  mean  zero,   Xc  is  an  unbias« 
ed  estimate  of  Z/  .   The  variance  of  this  estimate  is  the 
sum  of  the  variances  of  the  component  averages.   Since  the 
variance  of  an  average  is  the  variance  of  one  item  divided 
by  the  number  of  items, 

<*>      C""  'Art  •«*  crl  *  a*  cr*2 
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In  random  sampling  we  choose  a  men,   b  days  and  ob- 
serve each  of  k  mean  at  n  random  times  each  day,   V/e 
then  take  the  observed  proportions  pjj  for  each  man-day, 
and  average  them  as  we  did  for  the  Xj*  in  the  all-day  study, 

«'-l£J(X1J  t  f  Li)  from  (1) 

•!*£*[/'  * wi  * dj  *  (wdiiJ  *  ^o 

from  (3) 
=  //♦  w  ♦  3  ♦   (55)   4-  1  ££  Sli 

Thus  we   have   the  same  random  errors  as  in  all-day  study  plus 
the  amount     ^£££ia      Since  this  has  mean  zero,     XR  is  also 
an  unbiased   estimate  of    IJ  .      However  the   variance  of  X     will 
be  equal  to  that   of  X      (for  the   same     a,    b,    k)   plus  the 
variance  of   l££^i<* 

Each    4   <i   is  different  and  is  the  result  of  random 
processes,    the  choice  of  a  man  and  day,   and  the  choice  of 
the     n     sampling  times  during  the  days.     We  can  compute 
its  variance   using  conditional  expectations: 

•var    £1(J     =     E(tJfj)      z     EX[E(    f  fj/XtjiJ 

=     ExflXij      U  "  xij)7  from   <2) 

..  *  c/f-rS  v"2> 

z     //(  i  -  //)    -  (Tw  -  (Td     ♦  CTwd 
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Since  this  does  not  depend  on  i  or  j ,  we  get  for  the 

average 

2  2  2 

var(l    £J  <$"..)      =         U  (    1  -    //)      -   P*w     +   C7d     *  CTwd 

a"b      1J       /  nao  nab 


Combining  this  with  (4),  we  get 

(5)  *»  sH?- *  ib^2  *  y^-^ir^ 

The  possible  advantage  of  the  random  method  other  than 
reduction  of  bias  lies  in  reducing  the  cost  of  observation. 
Whereas  one  observer  can  handle  one  or  two   (k  =  1,2)  men 
a  day  on  an  all-day  basis,  he  will  be  able  to  handle  a 
larger  number  on  a  random  basis.   Thus  both  a  and  b 
can  be  made  larger  while  the  number  of  days  of  observation 
(ab/k)   remains  the  same.  This  will  usually  reduce  all 
the  components  of  variance  of  the  mean  except  the  one  due 
to  days,  and  will  put  in  an  additional  component  which  de- 
pends on  the  mean  we  would  like  to  know.   Depending  on 
the  values  of  \7"^,  0*|,  C"wd>  aaclZ/  the  random  variance 
may  be  less  than  the  all-day  variance  for  two  plans  which 
cost  the  same. 

If  an  expression  can  be  obtained  for  the  cost  of 
sampling  under  each  scheme,  the  variance  of  the  estimate 
can  be  minimized  for  a  fixed  cost.  That  is  a,   b,   k, 
and  n  can  be  chosen  so  as  to  make  the  error  smallest. 
Then  the  smallest  possible  all-day  error  variance  can 
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be  compared  with  the  minimum  random  error  variance  for  the 
'same  cost,  and  conclusions  drawn  as  to  which  plan  is  best. 

Under  the  following  very  simple  cost  arrangement  the 
results  are  no£  realistic  but  indicate  the  general  idea. 
Assuming  that  the  cost  is  the  daily  wage  of  the  observer 
and  that  he  can  take  care  of  two  men  under  all-day  time 
study,  the  minimum  variance  is  obtained  when  he  observes 
as  many  days  as  possible,  two  different  men  each  day. 
(The  cost  is  the  number  of  days  spent  sampling).   This 
makes  the  number  of  men  a,   as  large  as  possible,  as 
well  as  the  number  of  man  days.  For  random  sampling 
suppose  the  number  of  men  one  observer  can  handle  is  in- 
versely proportional  to  the  number  of  times  per  day  each 
man  is  observed.   Then  the  result  is  that  he  should  ob- 
serve as  many  men  as  possible  each  as  few  times  per  day 
as  possible.   With  proper  interpretation,  these  results 
can  indicate  the  things  to  aim  at  when  choosing  a  samp- 
ling plan.   However,  if  only  a  few  sampling  plans  are 

feasible,  the  variances  of  each  should  be  calculated  and 

o  2     2 

compared.  For  this  a  knowledge  of  CT^»  (T&%   0"wd»  and 

JUt  are  necessary. 

L.  COTE 
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APPENDIX     B 
SYMBOLS  AND  DEFINITIONS 
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SYMBOLS  AND  DEFINITIONS 

Symbol  Definition 

a        number  of  men  observed  in  work  sampling. 

a*       number  of  men  observed  in  all-day  time  study. 

b        number  of  days  each  man  was  observed  in  work 
sampling. 

b1       number  of  days  each  man  was  observed  in  all-day 
time  study. 

C        subscript  to  denote  all-day  time  study  (Continu- 
ous) . 

i        subscript  denoting  rows  (men)  in  statistical 
matrix. 

j        subscript  denoting  columns  (day)  in  statisti- 
cal matrix. 

k        number  of  men  observed  each  day.  Equal  to  a 
in  this  study  but  not  necessarily  so. 

n        number  of  times  per  day  each  man  is  observed 
on  work  sampling. 

n . *  from  statistical  matrix,  number  of  times  man, 

J  i,  is  observed  on  day,  j.  Used  in  this  sequel 
for  the  case  where  each  man  is  observed  a  dif- 
ferent number  of  times. 

N  total  number  of  observations  (  n  x  a  x  b) . 

p  proportion. 

R  subscript  to  denote  work  sampling  (Random). 

X  sample  mean  or  average. 

O  difference. 

LI  true  mean  or  average. 

0"  standard  deviation 

i  sum  of  or  summation 

v  variance 
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issue        function  consisting  of:  from  information  on 
standard  forms  for  material  requests  clerk 
checks  cardex  to  verify  location,  procures 
material,  verifies  identification,  signs  in- 
voice, and  places  in  designated  area  for 
pick  up. 

receipt      function  consisting  of:  checking  incoming  stock 
against  invoice,  inspection  report  or  returned 
material  form;  counting  or  weighing  material; 
inspection  of  material  for  condition  (some 
material  is  returned  from  the  field  for  over- 
haul): verifying  the  location  from  cardex  or 
making  up  new  card;  entering  number  and  stock 
number:  placing  in  bin  or  on  pallet  in  proper 
location. 

delay        function  consisting  of:  all  non-working  time 

(not  including  lunch  time),  including  personal 
time  and  time  lost  to  lack  of  work  or  inter- 
ruption by  foreman,  supervisor,  or  other  work- 
ers. 

screening    function  consisting  of:  time  spent  in  assisting 
production  personnel  in  verifying  the  identi- 
fication or  availability  of  desired  stock  prior 
to  the  preparation  of  a  material  request.  Used 
primarily  in  highly  technical  material  where  a 
stock  number  in  the  catalogue  is  not  a  precise 
description  or  the  interchangeability  of  ma- 
terial is  doubtful.   Also  used  when  records  are 
not  accurate. 

records      function  consisting  of:  maintenance  of  IEM 

cards  and  Function  sheets  for  cost  accounting, 
logging  of  serial  numbers  on  items  having  num- 
bers, changing  stock  number  or  custody  desig- 
nator on  reclassified  material,  and  miscellan- 
eous paperwork. 

x-tra        function  consisting  of:  rewa rehousing  to  im- 
prove storage,  issuing  patterns  and  molds  to 
shop  personnel,  surveying  overaged  or  unrepair- 
able material,  cyclic  preservation,  supervis- 
ing or  directing  an  assistant,  issuing  and  re- 
ceiving shop  laundry,  miscellaneous  work  in- 
cluding cleanup  of  area. 
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APPENDIX  C 
FORMULAE  AND  SAMPLE  CALCULATIONS 
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FORMULAS   AND  SAMPLE    CALCULATIONS 

ISSUE : 

Y/ork  Sampling 

r       a         2  2 1 

Row  Sum  of  Square3  (W)   -  1.  I  Q  £   xi#   -  X..^ 

s  1   f 8  (149,224.33)  -  752,278.68*1 
12  J 

8  13,797.38 
where  X^  -  X^  ♦  Xi2  *  xi3  *  xi/. 


and   X##   =  %     Xv      «    f.   X#j 


a  b 

1=1  *     3«i 

and   X^   =  Xxj   ♦  X2j   ♦ ♦  Xgj 

b 


Column  Sum  of  Squares  (D)   =  1   |  b  5  X  ,   -  X 

a"b   L   &  *j     "'J 

s  1    |*4  (192,489.28)  -  752,278.68] 

-  552.45 

Total  Sum  of  Squares       =1   fab  £   ^   X?4  -  X2 

ab      Li«l        jTl        iJ  *J 

r     1     [32(45,892.29)   -  752,278.68*J 

=     22,333.58 

Interaction   (I)      =     Total  -  M  -  D  =   22,383.58  -  13,797.38  - 
r  552.45 

«  8033.75 

a         b 
A     s     1         £         $       1  1      (3.27136)      -     0.10223 

ab     1=1        JS1     nij     "     T2 
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._  2  .     i  r  w    -       i        i 

U    w  =       ¥  L^T  (a-D(b-l)  J 

4        1  ri3. 797.38  -  8,033.75] 


^       397.12 

n-  2    .         lfD 
CT  d  a        albTT 


(a-D(b-l) 


63 


.3 

1  f552.45     -     8033.757 

0   (negative  number  has  no  meaning) 

i     f     _i  -   a/x(i-x)  -  B"5  -    cAl 

*       1.11387     T382.56     -     0.10223(27.10(72.90)   -   397.12 
1       246.37 

tlTxc:     1   C"w2     *     kCTd2     ♦       1     rJ     t     A    \J/{1-JV) 
a  ab"  ab"  aTL 


<r.h 


•»)] 


r2 


W 


OV    .    (Twi] 


r? 


R 


XR 


*R 


i     1(397.12)      ♦     0     ♦     1      (242.36)     t     0.10223 
"     S  T?  32 

[27.10(72.90)      -     397.12     -     0     -     246.37* 

£     61.60 
2 


=V6xR  7.85 


X..  867.34     r     27.10 
ab-     *  32 

4 

£  X*  z     447.08     3     27.94 
1=1  *'  "To- 

4b 


All-day  Time  Study 


a'      b 


B  Sum  of  Squares      -      £        $"       X,  ,      -      1  X  2 


=     16446.83  -  1(93,299.70) 


3 


r     4,784.37 
a'      b« 


a 


C   Sum  of  Squares     -      i 


i=l      Jrl 


x.     -    i      :£      X,2 

iJ  P        1-1  i' 


:     16,446.83     -     1(31,838.18) 

2 


(Tw 


2      . 


-     527.74 

1  fB     -      (a'b*      - 

»(a»-l)   L 


a'(b'-l)  J 


.      1  [4,784.37     -     7/4(527.74)] 


s 


643.60 


ITd     ♦     0"wc 


af(    b'-l) 


*     527.74       £     131.94 


est 


rr-2 


St 


a*       w 


w 


1 


(  rd2  ♦ 


rj) 


<r* 


1     1(643.60)     t     1   (131.94) 


4     177.39 
=     13.32 


Xr  :     X..     =     305.45     =     38.18 


a^T 


r 
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If  ^     £     Xq,    that  is   if   they  are  estimates   of   the  same  mean 

*      1.96 


XR  "  XC 


v^r^5 


U9 
will   indicate   that  at   the   5$  level  there   is  no  significant 
difference  and   the   two   estimates  may  be  presumed  to  be 
of  the   3ame  mean,   X. 

[27.10  -   ?8.18|    _     ii.og     s      .814  <:     1.96 


,10   -    38.1S|  11.08 

13.61 |         IJ75T 


50 


APPENDIX  D 


TABLES  of  DATA 
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TABLE  4 


Work 

Sampling 

Record  of 

Observati* 

ana 

Day 

1 

2 

3 

4 

Men 

1 

7 

10 

14 

13 

2 

6 

7 

7 

8 

3 

11 

10 

19 

10 

4 

9 

16 

6 

7 

5 

14 

9 

15 

13 

6 

13 

11 

10 

7 

7 

13 

6 

11 

14 

8 

10 

12 

19 

15 

^HiJ  =  3W 


52 


TABLE   5 
Work  Sampling 
Receipt   in  $  of  Observations 


Day 
Man 

1 

2* 

3 

4 

5 

6* 

7 

8 


28.57 
x 

45.45 
0 

7.14 
x 

0 
10.00 


30.00 

x 
10.00 
6.25 
55.56 

x 
33.33 
0 
135.14 


Totals  91.16 

^  XU     -     84930.49 
2xj     =     98730.56 

iXjJ      =      29200.58 

Sum  of  Squares 
Men   (W)  6637.84 

Days    (D)  1860.32 

Interactions    (I)     6107.65 
Totals  14605.81 

Ft2  - 


14.29 
x 

33.33 

0 
60.00 

x 
18.18 
5.26 
131.06 


76.92 

x 
10.00 
14.29 
92.31 

x 
14.29 

26.67 
234.48 


Totals 
149.78 

98.78 

20.54 
215.01 

65.80 

41.93 
591.84 


*R 
*R 


:  350274.59 
n  24.66 

=      22.43 


d.f.  Mean  Squares 
5      1327.57 
3       620.11 

15      407.18 

23 


230.10 

35.49 
298.56 


est 


r  64.81 


function  not  normally  performed  by  observed  workers 
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TABLE  6 

Work  Sampling 
Issue  in  %  of  Observations 


Day 

1 

2 

3 

4 

Totals 

Man 

1 

14.29 

20.00 

28.57 

0 

62.86 

2 

50.00 

100.00 

57.14 

62.50 

269.64 

3 

0 

40.00 

25.00 

10.00 

75.00 

4 

0 

6.25 

33.33 

0 

39.58 

5 

57.H 

11.11 

13.33 

0 

81.58 

6 

76.92 

36.37 

30.00 

85.71 

229.00 

7 

7.69 

33.33 

18.18 

7.14 

66.34 

8 

20.00 

16.67 

0 

6.67 

43.34 

Total* 

j  226.04 

263.73 

205.55 

172.02 

867.34 

2 

x  2  - 
Xi.  = 

149,224.33 

X.f  z       752, 

278.68 

£ 

X.j   = 

192,489.28 

h 

- 

27.10 

i 

T  2  . 

45/892.29 

* 

- 

27.94 

Sum  of  Sqi 

aares  c 

i.f. 

Mean  Squa 

res    (7" 

Men  (W) 

13797.^8 

7 

1971, 

.05 

397.12 

Days  i 

(D) 

552, 

.45 

3 

184, 

.15 

0 

Interactions 

(I)     8033. 

,75    21 

382, 

.56 

246.37 

Totals 

22383. 

.58    31 

est  1 

GV  : 

61.60 
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TAELE  7 
Work  Sampling 
Delay  in  $  of  Observations 


Day 
Man 

1 

2 

3 

4 

5 
6 

7 
8 


57.14 
0 

54.44 
55.56 
35.72 

0 
23.08 
40.00 


Totals      266.05 


30.00 

0 
40.00 
68.75 
11.11 
27.27 

0 
16.67 
193.80 


28.57 
42.86 

41.67 
50.00 

26.67 
40.00 

9.09 

47.37 

286.23 


23.08 
25.00 
80.00 
42.86 

7.69 

14.29 

71.43 

39.99 

304.34 


Totals 

138.79 
67.86 

216.22 

217.17 
81.19 
81.56 

103.60 

144.03 
1050.42 


:^     =     162,502.99 


. . 
=     282,891.49  XR 

£xi|     r     48,994.64  X^ 

Sum  of  Squares 


•  J 


r     1,103,382.18 

Z  32.83 

z  40.00 

d.f.     Mean  Squares       J" 


Men   (W) 
Days    (D) 

Interactions  (I) 
Totals 


6145.06 

880.74 

7488.14 

14513.94 


7 

3 

21 

31 


877.87 
293.58 
356.58 


130.32 

0 
160.92 


es 


t  av  „ 


27.43 
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TABLE   8 

Work  Sampling 
Screening  in  %  of  Observations 

Day  12  3  4  Totals 

Man 

1  0  10.00  0 

2  0  0  0 

3  0  0  0 

4  0  0  0 

5  0  0  0 

6  7.69  0  0 

7  0  0  0 

8  0  0  0 
Totals              7.69          10.00  0 

2  X  2     =        159.14  X.? 

Sx.J     r       159.14 

SxJ     =       159.14  XR 

Sum  of  Squares  d.f.  Mean  Squares     (J" 

Men    (W)  30.00  7  4.29         0 

Days    (D)  10.11  3  3.37         0 

Interactions    (I)  109.25  21  5.20  0 

Totals  149.36  31 


R 


0 

10.00 

0 

0 

0 

0 

0 

0 

0 

0 

0 

7.69 

0 

0 

0 

0 

0 

17.69 

2.95 

0.55 

0.63 
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TABLE   9 

Work  Sampling 

Records 

in 

%  of  Obs 

jervatlons 

Day 

1 

2 

3 

4 

Totals 

Man 

" 

1 

0 

0 

0 

0 

0 

2 

0 

0 

0 

0 

0 

3 

0 

0 

0 

0 

0 

4 

33.33 

18.75 

0 

14.28 

66.36 

5 

0 

0 

0 

0 

0 

6 

7.69 

9.09 

30.00 

0 

46.78 

7 

69.23 

0 

0 

0 

69.23 

8 

30.00 

66.66 

36.84 

26.67 

160.17 

Totals 

i  140.25 

94.50 

66.84 

40.95 

342.54 

£ 

*!  = 

37, 

039.24 

X2 

=     117,333, 

,65 

^ 

XJ  -- 

3/, 

744.80 

*r 

z 

10, 

,70 

€ 

Y    2 

xij   x 

14, 

912.96 

x« 

8 

• 

4. 

,15 

Sum 

of  Squares       d.f. 

Mean  Squares          (7" 

Men   ( 

;wj 

5593. 

13 

7 

799, 

,02 

140.51 

Day  3 

(D) 

676. 

42 

3 

225, 

,47 

0 

Interactions 

(I) 

4976. 

73 

21 

236.99 

171.17 

Totals 

11246. 

28 

31 

est 

(Tx2 

:      2 

4.97 

57 


Total3 


TABLE   10 
Work  Sampling 
X-tra   in  %  of  Observations 

Day              1    r               2                    3  4 

Man 

1  o                10.00            28.57  0                  38.57 

2  50.00                0                    0  12.50              62.50 

3  •     o                10.00                0  0                  10.00 
U           11.11               0               16.67  28.57             56.35 

5  0                 22.22                 0  0                   22.22 

6  7.70            27.27                0  0                  34.97 

7  0               33.34           54.55  7.14             95.03 

8  0                    0                10.53  0                 10.53 
Totals     68.81          102.83          110.32  48.21            330.17 

*-       2  2 

Z-  x1#     =     19527.43                        X_  z     109,012.23 


. . 


2  - 

^x.j  Z     29803.53          XR  =  10.32 

£xij  =  10435.85          *R  =  10*46 

r-2 

Sum  of  Squares  d.f.  Mean  Squares    \y 

Men  (V)          1475.23       7  210.75  0 

Days  (D)          318.81       3  106.27  0 

Interactions  (I)   5235.18  21  249.29       0 

Totals  7029.22  31 
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TABLE  11 

All-day  Time  Study 

Receipt  in  %   of  Time  Observed 

Day  1  2       Totals 
Man 

1  32.93  34.58       67.51 

2*  x  x          x 

3  21.25  39.17  60.42 

4  0       9.17       9.17 
Totals     54.18     82.92      137.10 


2*1? 

- 

8292.27 

x.i 

}     -   18796.41 

*\\ 

- 

4350.10 
Sum  of  Squares 

£c 

z              22.85 

Men 

203.97 

219.35 

Days 

t 
Interacts 

>ns 

1217.37 

67.99  • 

I 

^Function  not  normally  performed  by  operator 


TABLE   12 
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All-day  Time  Study- 
Issue  in  %  of  Time  Observed 


Day 

1 

2 

Totals 

Man 

1 

9.16 

5.63 

14.79 

2 

69.59 

68.57 

138.16 

3 

61.25 

36.25 

97.50 

4 

17.29 

37.71 

55.00 

Totals 

157.29 

148.16 

305.45 

*xi! 

z        31838.18 

x.?  z 

93299.70 

*xi! 

16446.83 

*c   = 

38.18 

Sum  o: 

f  Squares 

<r 

a. 

Men 

527.74 

643 

.60 

Days 

* 

4784.37 

131 

.94 

:erecti< 

Dns 

TABLE   13 
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All-day  Time  Study 
Delay  in  $  of  Time  Observed 

Day      1  2 

Man 

1  12.29 

2  28.75 

3  15.83 

4  74.38 


Totals  131.25 


£x,2  -   17910.56 
^X    z         9710.29 


17.50 

29.79 
21.04 

36.24 
104.57 


X.? 


Sum 

of  Squares 

Men 

755.01 

Days 

2753.91 

Interactions 

Totals 

29.79' 

58.54 

36.87 

110.62 

235.82 

55611.07 
29.48 

239.65 
188.75 
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TABLE  14 

All-day  Time  Study 
Screening  in  %   of  Time  Observed 


Day 

1 

2 

Totals 

Man 

1 

1.87 

2.71 

4.58 

2 

1.66 

1.46 

3.12 

3 

0 

0 

0 

4 

0 

0 

0 

Totals 

3.53 

4.17 

7.70 

*H2. 

-        30, 

,71 

X.? 

r       52.29 

*H] 

Z       15 

.73 

*C 

=         0.96 

Sum  of  Squares 

cr* 

Men 

0.37 

1.28 

Days 

♦ 

8.32 

0.09 

Interact! 

ons 
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TABLE  15 

All-day  Time  Study- 
Records  in  %   of  Time  Observed 


Day 

1 

2 

Totals 

Man 

1 

15.00 

0 

15.00 

2 

0 

0 

0 

3 

0 

0 

0 

4 

8.33 

16.88 

25.21 

Totals 

23.33 

16. * 

38 

40.21 

*H* 

-        86C 

'.54 

X.? 

=       1616.84 

*hi 

z       579 

'.32 

*C 

=              5.03 

3um 

of  Squares 

<ra 

Men 

149.05 

19.40 

Days 
t 
Interactions 

377.22 

37.26 
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T^ABLE   16 

All-day  Time   Study 
X-tra   in  %  of  Time  Observed 
Day  1  2  Totals 

Man 

1  28.75  39.58  68.33 

2  0  0  0 

3  1.67  3.54  5.21 

4  0         0  0 
Totals   30.42      43.12       73.54 


S-It2 

- 

4696, 

.13 

X.? 

z       5408.13 

**lf 

- 

2408, 

,46 

*C 

I             9.19 

Sum  03 

f  Squares 

or* 

Men 

60.39 

271.18 

Days 
♦ 
Interactic 

1732.44 

15.10 

>ns 
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